動的レイヤ表現を用いた Video - Based Rendering Video - Based Rendering with Dynamic Layered Representation

Abstract: A new technology called “Image-Based Modeling and Rendering (IBMR)” has been attracting much attention in the field of 3-D computer graphics. It aims to describe 3-D spatial data using a set of real images or light rays, while the structure data (shape and texture) is essential for traditional techniques. The authors proposed and developed a real time IBMR system in which all the processing including capturing, warping, stitching and rendering are completed in real time. We named the system “VideoBased Rendering (VBR),” since it utilizes video sequences instead of static images. In this paper, the authors make the VBR system more flexible, and improve the quality of synthesized images. First, a flexible camera array system is constructed. Secondly, in order to suppress the discontinuities between stitched videos, the alpha blending technique is applied, and a generalized plane model is introduced. Thirdly, a real time measurement technique is combined to the VBR system. This enables that a set of dynamic layers can be utilized as coarse structure of dynamic 3-D scenes to improve the quality of synthesized images. Experimental results show that the proposed method is applicable and useful for the interactive 3-D rendering of real scenes.